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ON  THU  THEORY  OF  a GE— DEPEN HUNT  STOCHASTIC  BRANCHING  PROCESSES 

Richard  Bellman  and  Theodore  Harris 


i 


§  1 .  Introduction. 

Um  nra  intnriwMrf  ^ 


the  following  problem 


which  is  of  possible  biological,  chemical  and  physical  interest,. 

A 


A  particle  existing  at  time  0  is  assumed  to  have  probabilities 

A><TL  ZJ> 

V  nwjo,  of  being  transformed  into  n  simile^ particles  at 
some  random  time  t  >  0.  Assume  that  iJe-start^  with  a  single  particle 
at  t  "0.  Under  the  hypothesis  that  any  particle  has  a  life— length 
probability  distribution  independent  of  its  time  of  birth  and  of 
the  number  of  other  particles  existing  at  this  time,  the  problem 
is  to  determine  the  probability  distribution  of  Z(t),  the  number 

of  particles  in  existence  at  time  t.  — - ^  T&  'f>,  -2_ 

The  simplest  case,  and  the  one  most  often  considered 
previously,  is  that  where  the  probability  that  a  particle  in 
existence  at  t  be  transformed  between  t  and  t  ♦  At  .is  aAt  ♦  o(At) 
and  is  thus  independent  of  age  and  of  absolute  time.  Here  the 
cumulative  distribution  G(t)  of  the  random  transformation  times 

— af 

has  the  form  G(t)  ■  1  —  e  .  For  this  particular  case,  the  problem 
is  more  tractable  due  to  the  convenient  fact  that  the  non-linear 
integral  equation  which  is  obtained  in  the  general  case  reduces 
to  an  ordinary  non— linear  differential  ecuation  which  in  the  case 
of  binary  splitting  is  of  Bernoulli  type  and  hence  can  be  solved 
in  elementary  terms;  see,  for  example,  D.  G.  Kendall,  W- 


1 

Expansion  of  results  announced  in 
Academy  of  Sciences .  Vol.  34  (1948),  pp. 


J 
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Unfortunately,  the  assumption  that  the  probability  of  trans¬ 
formation  is  independent  of  the  age  of  the  particle  is  not  realistic 
in  many  cases  of  interest.  Rather,  it  is  more  likely  that  the 
distribution  of  transformation  times  is  concentrated  about  a  certain 
mean  life  length.  This  is  particularly  likely  to  be  true  in 
biological  phenomena  such  as  the  growth  of  a  colony  of  bacteria. 

In  our  work,  we  assume  that  the  random  transformation  times 
have  a  cumulative  distribution  G(t),  where  G(0+)  «  0,  G(a>)  ■  1. 

?! 

Depending  upon  what  we  wish  to  prove,  further  assumptions  are  added. 

\  The  precise  restrictions  .will  be  given  below. 

y  Us  AjuJfcUtZS - ^ 

'  (  We  -  ihnll  restrict  flursslveyas  far  as  detailed  exposition  goes, 

to  the  special  case  where  only  binary  transformations  occur;  that  is, 

one  particle  can  be  transformed  only  into  two  others.  This  is  the 

most  important  case  biologically,  and  the  methods  employed  to  deal 

with  this  case  are  easily  extenaed^is^wilT  be -pointe-d-ant,  .later, ^to 

deal  with  the  general  case  with  n-ary  transformations.  _ 

It  should  be  mentioned  that  D.  G.  Kendall  has  recently 

treated  the  case  where  G(t)  is  a  k— fold  convolution  of  distributions 

—at 

of  the  form  1  —  e  •  In  this  case  the  process  can  be  considered 
as  a  Markoff  process  involving  k  types  of  particles. 

We  now  make  some  definitions  and  assumptions.  Set 

Pr ( t )  ■  Prob[Z(t)  -  r ]  ,  r  -  G,  1,  ••• 

f(s,  t)  -  jr>  Pr(t)sr  . 

The  generating  function, 

'  ri^Pr(t)sr 
2- 


(1) 


F(s,  t) 
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where 

(2)  pr(t)  -  Prob[Z(t)  -  r]  ,  r  >  0, 

and  Z(t)  is,  as  in  the  first  paragraph,  the  number  of  particles  in 
existence  at  time  t,  will  be  the  focal  point  of  our  investigations. 
Setting 

(3)  h(s)  -  ±  q  a" 

n-0  n 

where  qn,  as  above,  is  defined  to  be  the  probability  that  a  particle 
is  transformed  into  n  particles  when  transformation  occurs,  standard 
probabilistic  reasoning  leads  to  the  non-linear  integral  equation 

(4)  F(s,  t)  -  /  hf(8,  t-yQdG(y)  ♦  s(l  -  G(t))  . 

Jo 

The  classical  method  of  successive  approximations  yields  the 
result  that  there  is  a  unique  bounded  solution  of  (4)  for  |s|  <1, 
which  possesses  all  the  elementary  properties  of  a  generating 
function.  We  next  consider  the  distribution  of  the  random  variable 
defined  by 

(5)  W(t)  -  Z  ( t )  /E  (Z  ( t )_)  . 

To  this  end,  we  reauire  the  existence  and  asymptotic  behavior  of 
the  expectation  of  Z(t),  fci[Z(t)]  ■  m^t).  The  expectation  satisfies 
the  linear  integral  equation 

mi(t)  -  b,  J^m,(t-y)dG(y)  ♦  1  -G(t)  ,  (bj  ■  T  nqn)  . 


(0) 
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In  this  paper,  we  discuss  only  the  case  where  1  <  bj  <  oo.  In  this 
case  there  is  a  positive  probability  that  the  family  of  particles 
will  not  become  extinct. 

Equation  (6)  is  a  special  case  of  the  familiar  eouation  of 
renewal  theory  which  has  been  treated  generally  by  Feller  [2] , 
Tacklind  [7j ,  and  Bellman  and  Harris  [l]  •  In  the  present  case 
there  are  special  conditions  satisfied  which  enable  more  precise 
asymptotic  results  to  be  obtained. 

Under  the  assumption  that  b|  >  1  we  show  that  the  random 
variable  W(t)  converges  in  mean  square  to  a  random  variable  w. 

The  connection  between  Z(t)  and  w  is  as  follows.  Let  K(u)  be  the 
distribution  function  of  w  and  set 

(7)  Mb)  -  P*  esudK(u) ,  Re(s)  <0. 

J  0- 

Then  it  follows  that 

(8)  rf(s)  -  lin  f(.s/*  ,  t),  Re(s)  <0, 

t-  ->co  '  7 

and  consequently  that  jrf(s)  satisfies  the  non-linear  integral  equation 

(9)  Mb)  -  r"  h[^(8/eat)]dQ(t)  . 
at 

The  term  e  occurs  because  of  the  fact  we  prove  below  that 
E(Z(t))  mjeat  as  t  — the  constant  a  will  be  defined  below. 

The  properties  of  the  solutions  of  equation  (9)  are  now 
studied.  It  is  shown  that  for  the  solution  of  (9)  of  the  form  (7), 
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we  have 

(10)  ^(it)  — >  0,  as  t  — 1  od  , 

if  h(0)  -  0,  where  h(a)  is  defined  by  (3)*  A  consequence  of  this 
is  that  K(u)  is  continuous  in  u,  except  for  a  discontinuity  at 
u  ■  0  which  occurs  only  when  h(0)  /  0 .  /Imposing  a  further  condition 
of  the  type 

(11)  1  -  G(t)  -  0(._ct),  c  >  0, 

we  demonstrate  the  existence  of  a  density  function  for  K(u),  u  >  0. 

The  investigation  of  the  properties  of  the  solutions  of  the 
non-linear  integral  equations  requires  a  large  number  of  ad  hoc 
methods,  patched  together  in  no  obvious  fashion.  Considering  that 
we  are  dealing  with  non-linear  processes,  for  which  the  treatment 
is  as  yet  little  standardized,  there  seems  to  be  no  alternative  to 
this  potpourri  of  methods. 

The  models  treated  in  this  paper  are  susceptible  of  generaliza¬ 
tion  in  several  important  directions.  One  may  consider  the  more 
general  case  where  the  probability  of  transformation  is  dependent 
on  the  time  of  birth  and  on  the  number  of  contemporary  particles. 

Then  there  are  the  problems  of  the  distribution  of  ages,  the  number 
of  transformations  in  a  given  interval,  and  so  on.  Finally,  there 
is  the  case  where  there  are  particles  of  different  types  which  give 
birth  not  onl.,  to  those  of  the  same  type,  but  also  to  those  of  other 
types.  The  case  of  biological  mutation  is  an  example  of  this. 
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Finally,  we  may  mention  that  the  results  of  this  paper  are 
generalisations  of  those  contained  in  a  paper  by  one  of  the 
authors,  Harris  (3 J  ,  where  further  references  are  given,  and 
that  several  of  the  methods  of  the  present  paper  are  contained 
in  ovo  in  this. 

We  should  like  to  express  our  appreciation  for  the  many 
helpful  suggestions  of  the  referee. 


§  2.  Derivation  of  the  Integral  Equation. 

The  function  pr ( t ) ,  the  probability  that  r  particles  exist 
at  time  t,  satisfies 

(1)  Pr(t)  -  J'  P[Z(t)  -  r JyJdG( y )  *  Slr[l  -  G(t)J 

where  £1r  is  the  Kronecker  delta  function  and  p£z(t)  -  rjyj  is 
the  conditional  probability  that  Z(t)  ■  r  given  that  the  initial 
particle  was  transformed  at  time  y.  It  is  clear  that  this  condi¬ 
tional  probability  is  given  by 

( 2 )  P  fZ  ( t )  -  r  [ y]  -  ^  pi  ( t  -  y )  ( t  -  y )  . 


Substituting  (2)  in  (1),  multiplying  both  sides  by  s  ,  and 
summing  from  r  ■  0  to  u>  gives  the  following  integral  equation  for 
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K(s,  t)  *  J)Pr(t)sr: 

t  2 

(3)  F(s,  t)  »  ^  F  ( s ,  t-y)dG(y)  ♦  s£l  -  G(t)3  • 

If  G(y)  *  1  —  e  a^,  (3)  may  be  reduced  by  differentiation 
with  respect  to  t  to  an  ordinary  differential  equation* 


§ 3 •  Formal  Definition  of  the  Process. 

In  order  to  define  formally  the  stochastic  process  with  which 
we  are  dealing,  we  consider  the  space  -A.  of  functions  Z(t), 

0  <  t  <  as,  whose  values  are  nonnegative  integers.  First  we  must 
define  the  probabilities 

P[Z(t,)  -  r,  ,  ZUJ  *  rd ,  •••,  Z(tk)  »  rj  - 


P 


r,r2 


•  •  • 


•  •  • 

9 


for  every  k  nonnegative  integers  r5  ,  rk  and  every  k  nonnegative 

numbers  ttl  •••,  t^;  k  *  1,  2,  •••.  Once  these  definitions  have 
been  made,  provided  certain  consistency  relations  hold,  it  follows 
from  a  theorem  of  Kolmogoroff  [6]  that  a  probability  measure  is 
uniquely  defined  on  the  Borel  sets  of -A  .  By  "Borel  sets  of  JX” 
we  mean  the  borel  extension  of  the  field  of  cylinder  sets.  A 
cylinder  set  is  a  set  consisting  of  all  functions  Z(t)  such  that 
Z(t^)  €  S^,  i  ■  1,  2,  •••,  k,  where  is  any  set  of  nonnegative 
integers. 


-8- 

fwiOP 

Kev.  7/14/50 


We  define  the  probabilities  P  r  (tj  ,  •••,  tw)  by  means 

rj  rk  k 

of  the  generating  functions 

rk(»i .  »k;  t, ,  •••,  tk)  - 

Z  Pr,  ...  rk  (t,.  tk)  •••  8kk  . 

We  define  the  Fk  inductively,  for  0  <  tj  <  t,  <  •••  <  tk,  and  agree 
to  define 


rk|>n<1)'  '**>  ®n  ( k )  ’  VO)-  *nU>]  - 

*K[S"  '**>  sk:  t"  ”*• 

for  any  permutation  n(l),  •••,  rr(k). 

Having  defined  F  j  ( s  j ,  tj  )  ■  F(sj,  ti )  by  means  of  (4), 
Section  1,  and  assuming  that  F|  ,  F, ,  Fk  have  been  defined,  we 

define  Fk4l  by  means  of  the  equation 

***»  sk-*1  •  t'k-M  ^ 

fQ  'h[Fk-1(s'-  •••-  ®k+1  ’  t'~y>  tk+1  -y)]<10(y) 

*  s,  f  <ih[Fk(s4,,  •••,  sk+1;  t,-y,  •••,  tk4l-y]dC(y) 


U  t| 


-  •••  ♦  s,s,  •••  sk  /  h[F,(sk4l;  tj 

tk 

+  3,82  ”•  8k+,[l  -  G(tk+,)]  . 


y  )JdG(y ) 
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The  probabilistic  reasons  for  the  definitions  (1)  are  analogous  to 
those  given  in  paragraph  2. 

If  Fj  ,  •••,  1*’^  are  known  to  be  probability  generating  functions 
it  can  be  shown,  following  methods  to  be  used  in  Section  4»  that 

(1)  determines  uniquely  among  bounded  functions  the  probability 
generating  function  Fk<t>1  ,  provided  0  <  t|  <  •••  <  tk4j. 

It  remains  only  to  show  the  consistency  of  the  probabilities 
that  have  been  defined.  This  can  be  done  by  repeated  application 
of  the  following  type  of  argument.  Set  S|  *  1  in  (1),  thus 
obtaining  an  equation  for  Fjc<f1(1,  s2,  ***)  which  is  now  identical 
with  the  equation  used  to  define  Fk;  because  of  uniqueness,  this 
implies  Fjt<f1  ( 1  ,  s2 ,  •••)  -  Fk(s2,  •••;  t2 ,  •••). 

§4.  Existence  and  Uniqueness. 

We  shall  demonstrate  the  following  result; 

Theorem  1 :  Under  the  assumptions 

(1  )  (a)  dG  >  0,  G(0*)  -  0,  G(od)  ■  1  , 

(b)  G  continuous  from  the  right . 

there  exists  a  solution  of  the  integral  equation . 

(2)  F(s,  t)  -  s  (l  —  G(t))  ♦  /’V(3,  t-y)dO(y), 

Jo 

which  h as  the  following  properties: 
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(3) 


(a)  F(o,  t)  -  p  (t)ar,  fgr  |a|  <  1,  aa£  £ii  t  >  0. 

r  ■  1 

(b)  F( a ,  0)  •  s,  F(1,  t)  ■  1, 

(c)  Pi  (t)  -  1  -  G(t) 

PrU)  m  f0  ^  pJ(t  »  r  £  2» 


whanct .  in  particular. 

(d)  pr(t)  >  0  . 

The  functlona  pr ( t ) ,  r  ■  1,  2,  •  •  • ,  and  F  (  s  ,  t ) ,  |  s  |  <  1  t 
are  of  bounded  variation  over  every  finite  t— interval. 

Furthermore,  the  above  solution  is  the  sole  solution  of  (2) 
which  ia  uniformly  bounded  for  all  t  >  0 ,  for  each  a  in  j  s  |  <  1 . 

Proof :  Let  us  agree  to  the  convention  that  a  Stieltjes  integral 

J,b  pb+ 

f(y)dg(y)  is  to  be  interpreted  as  /  f(y)dg(y). 

a  u  a+ 

We  shall  utilize  the  method  of  successive  approximations. 

Define 

(4)  fr’o (  s  »  t)  -  s(l  -  G(  t ) )  , 

t  j 

Fp^i  ( 8 «  t)  «  s(l  -  G(t))  +J  Fn(s,  t-y)dG(y),  n  > 
It  follows  readily  by  induction  that 
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For  if  the  inequality,  clearly  true  for  n  •  0,  be  assumed  to  hold 
for  some  n,  we  obtain  from  (4)* 

nt 

(t)  |Fn4lJ  <  J  dG(y )  ♦  1  —  G( t )  -  1. 

We  first  prove  that  the  sequence  Fn(s,  t)  converges  for  all 
s  in  the  interval  [b ,  ij  as  follows.  Each  Fn  is  non— negative ,  and 
since  Fj  >  F0,  it  follows  by  induction  that  >  Fr.  Consequently, 

since  for  each  s  in  [0 ,  ij  ,  the  sequence  jV^  Is  monotone  increasing 
in  n  and  bounded,  it  converges  for  all  s  in  [0t  l] .  Call  the  limit 
function  F(s,  t).  Using  the  Lebesgue  bounded  convergence  theorem, 
we  see  that 

(7)  F(s,  t)  -  /  F  (s,  t-y)dG(y)  ♦  s(l-G(t)),  0  <  s  ^  1. 

U  0 

The  sequence  ^F^J  is  thus  a  uniformly  bounded  sequence  of 
analytic  functions  of  s  in  the  unit  circle,  {s|  <  1,  which  converges 
on  the  segment  o  <  s  ^  1.  It  follows  from  Vitali's  theorem,  that 
the  sequence  converges  uniformly  to  an  analytic  function  in  any 
closed  rerion  within  the  unit  circle.  It  is  not  difficult  to  give 
a  further  argument  showing  that  the  convergence  is  uniform  in  and 
on  the  unit  circle  due  to  the  positivity  of  the  coefficients  of  the 
power  series  developments  for  Fn(s,  t).  However,  it  is  not  entirely 
easy  to  generalise  this  line  of  proof  to  cover  systems  of  equations 
of  type  (2),  For  this  reason,  we  present  the  following  proof, 

which,  although  more  pedestrian,  is  quickly  applicable  to  the  more 
general  situation. 
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We  have  for  |s|  <  1,  n  >  1, 


<8>  Fn*1  '  Fn 


J "*  P'n*9.  t_y  >  -  Fn-1  < 3 .  t_y>][Fn(s>  t-y '  *  Fn-i ( 8  >  t-y)]dG(y), 


whence 


(9) 


J*n*l“FJ  -  2J0  lFn(s’  t-y  )  ~  *’ n-1  (  3  »  L-y)l  dG(y) 


Restrict  l,  temporarily,  to  the  interval  [p ,  T] ,  where  i  is  chosen 
so  that 

T 


(10) 


2  dG  <  b  <  1 . 


This  is  possible  since  G(0)  ■  0.  With  this  restriction  (9)  yields 


(11) 


Sup  JF 

J-t-T 


n*1 


Pnl  5  b  Sup  !F  -  F  I, 
CKt<T  n  n  1 


n  >  1 


From  this,  we  obtain 


(12) 


Sup  JF 
CKt<T 


n*1 


-  Fn'  *  *"• 


n  >  1  , 


since  |F|  —  F0  |  <  1 .  Consequently ,  for  0  <  t  <  T,  f  s  J  <  1,  the 
series 


(13) 


OD 


n«0 


'Fn*1  -  Fn>  • 


converges  uniformly  in  t  and  s. 
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Let  us  now  establish  convergence  in  the  interval  T  <  t  <  2T. 

We  have,  in  this  interval, 

(14)  Fn«1  "  Fn  • J ^  T  t_y)_Fn(8*  t-y )]  [•  • -]dO(y) 

and  thus 

t— t 

05)  lFn«1-Fnl  -2J0  lFn(s>  t-y)_Fn-1(a*  t-y,ldG(y) 

,  t 

♦  2  I  |Kn(s,  t_7)~  Fn-i(a»  t-y)  I  d°(y)  »  n  >  1 . 

We  have  already  shown  that  |Fn<f1  —  Fn|  <  bn  in  the  interval 
0  <  t  <  T.  Hence,  since  0  <  t  —  y  <  T  for  t—T  <  y  <  t,  we  have 

t— t 

(16)  |fn*i  ”  Fn  I  ~2J0  !Fn(a’  t-y)_Fn-1ls’  t~y  >  |  dG(y)  ♦  2bn,  n> 
|K,  -  F0[  <  1. 

From  this  it  follows  easily  that 

(17)  Sup  |F  ,  -  r  !  i  (2n  *  1)bn  , 

rp  .  4  n\  ill  II 

i^t^e.  I 

CD 

ana,  therefore,  that  the  series  2  (Fn4l  “  Fn)  converges  uniformly 
in  s  and  t . 

This  same  argument  may  be  ti.en  repeated  over  the  interval 
[2T ,  3Tj *  and  so  on.  From  this  we  conclude  that  Fn  converges 
uniformly  to  F(s,  t)  over  any  fixed  t— interval,  for  |s{  <1.  An 
argument  of  similar  type  shows  that  (2)  has  only  one  bounded  solution. 
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Referring  to  (3),  we  see  that  (a)  follows  from  the  fact  that 
Ha,  t)  is  a  limit  of  bounded  sequences  of  power  series  with  non- 
negative  coefficients;  the  second  part  of  (b)  follows  from  the 
uniqueness  of  a  bounded  solution  -  in  this  case  1;  and  (c)  follows 
by  equating  coefficients  in  (2). 

It  remains  to  show  bounded  variation.  We  have,  for 
t,  >  >  •••  >  tn_,  >  tn  , 


(18) 


rls,  tk)-  FIs,  tk+1) 


■  P  *  F*(s,  tk— y)dG(y) 

♦,/  k  ^^(s,  tk-y)-Fa(s,  tR4l-y  )]dG(y) 


♦  s  (  G(  tk<f  1  )  -  G(  t k)). 


Thus , 
(19) 


|F(s,  tj-  FIs,  tk„,  )|  i  2 


rtk*1 


|F(s,  tt— y ) —  F( s ,  tk<1-y) |dG(y) 


♦  2(G(tk)  -  G(tk+1  ))  . 


Write 

f  **  .  •'*».  rVl  .  ... 

Jo  Jo  J t 

P 

(20) 

L/  tk^.1 

and 

(21  ) 

VN  ’  aus  Z  |F(s,  tk)  -  FIs, 

tk^1 * 1 » 

N 

s !  <  i 
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Clearly  .  Adding  the  inequalities  of  (19),  using  ths 

decomposition  of  (20)  ana  the  notation  of  (21),  we  obtain 

U2)  "z  |F(».  tk)-F(s,  tk+1)|  <  2Vnf\a{y)*  2  ""’dOiy) 


♦  •••  ♦  2  V  ^  I'*' dG(y) 

■'  t2 

♦  2 ' G( 1 1  )  -  G(tn)) 


Therefore 


^  2Vn 


♦  2(G(t,)  -  0(tn))  . 


(23) 


V  < 
n  — 


2  / 

do 


dG(y)X  V 


n 


2  . 


If  we  at  first  restrict  ourselves  to  the  interval  [0,  T] ,  where 
T 

2  /  dG(y)  -  b  <  1  ,  we  deduce  that  V  5  2/0  -  b),  for  all  n,  whence 

i'  0  n 

bounded  variation.  To  establish  bounded  variation  over  [T,  2Tj  ,  we 
proceed  as  in  (15)  ana  (it). 

Let  us  note  that  to  extend  our  result  to  cover  the  more 
general  equation 

(24)  K(s,  t)  -  h  F  ( s ,  t-y)dG(y)  ♦  s  1-G(t))  , 

0 


where 


(25)  h(x)  -  Z  a  xn  ,  Z  a  ■  1  ,  a  >  0, 

n-2  “  n-2  n  n 
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we  need  only  add  the- additional  condition  h’(1)  <  00.  The  method  of 
proof  is  then  the  same. 


§  5.  Properties  of  the  foments. 

Let  us  now  discuss  some  further  properties  of  the  solutions. 
The  first  result  is 

Theorem  assuming 

( 1 )  dG  >  u,  G(0* )  -  0,  G(oq)  -  1  , 


then  all  the  moments 

(2) 


00  k 


m.  ( t )  -  21  n  p.  ( t ) 

K  n- 1  K 


*  *  1  ,  2,  •••  , 


exist .  and  for  fixed  k  ,  and  any  £  >  0 , 


(3) 


mk(t)  -  O 


( ka*  t ) t 


e 


as  t  — >  00,  where  a  _i_s  the  pos iti ve  root  of 


(4) 


1  «  2 


CD 


e  &tdG(t). 


0 


For  each  k,  m  (t)  is  a  nondecreasing  function  of  t. 


Once  the  moments  have  been  shown  to  exist,  their  nondecreasing 
character  follows  if  we  can  show 


(5) 


Probfzft')  >  z(t)]  -  1 
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for  all  t*  >  t.  In  order  to  prove  (5)»  which  is  of  course 
intuitively  obvious,  we  consider  the  defining  equations  (1), 
Section  3,  with  k  ■  1.  We  need  merely  to  show  that  if 

K 2 ( s l  ,  s^;  t1  ,  t*)  is  written  as  a  power  series  in  8|,  the 

k  k 

coefficient  of  s, ,  for  each  integer  k,  contains  s*  as  a  factor. 

This  is  readily  done  by  successive  derivation  of  (l),  Section  3» 

with  respect  to  s,  at  s,  "0,  using  induction  on  k. 

Now  consider  m,(t).  For  |sj  <  1 ,  wa  have 

1 1 

(6)  K’(s,  t)  -  2  /  F*(s,  t-y)F(s,  t-y)dG(y)  ♦  1  —  G( t )  • 

iJ0 

(’  denotes  differentiation  with  respect  to  s.)  Hence 

(7)  |F»(s,  t ) ;  <  2  /  |F* ( s,  t— y ) JdG( y )  ♦  1  . 

d  0 

Set  |F'(s,  t )  '  •  ebtv(s,  t),  where  b  >  a,  a  being  defined  by  (4). 
Then, 

(6)  v(s,  t  )<  2  P  v{s,  t-y)e  bydG  ♦  e  bt , 

UO 

and  consequently, 

(9)  Sup  v(s,  t)  <  Sup  v(s,  t)  (  2  P  e  bydGj  ♦  1, 

u^tVjT  u^t<T  d  0  J 

or 

(10)  Sup  v  ( s ,  t)  <  1/  (1  -  2  /  e“bydG). 

Ovt<T  ^  0 

The  bound  is  independent  of  s  and  this  together  with  the  fact  that 
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Pr(t)  >  0,  implies  (3)  for  the  case  k  ■  1,  since  m,(t)  •  F * ( 1 ,  t)* 
Since  F(2)(1,  t)  -  E[Z(t)]*  -  E[Z(t)],  and  in  general 

( 1 1  )  t)  ■  E[Z(tj]^  ♦  expected  value  of 

powers  less  than  k  of  Z(t), 

( k ) 

it  suffices  to  consider  F  (1,  t)  rather  than  m^CtJ. 

The  second  derivative  for  jsj  <1  satisfies 

(12)  F^(s,  t)  *  2  p  F(s,  t— y)K^(s,  t-y>dG(y) 

VO 

t  ^ 

♦  2  /  [F’(s,  t-y)]  dG ( y )  • 

0 

Using  the  result  for  k  *  1  and  the  method  above,  wo  easily  show  that 

Sup  |FU)(s,  t)  | 

CKt<a> 

has  a  bound  independent  of  s  for  jsj  1.  Now 

F^2^(s,  t)  -  ^  (r  “  r)p  ( t ) s 17  ^ 

r- 1  r 

a 

and  since  r  —  r  is  positive  for  r  >  2,  the  tneorem  follows  for 
k  ■  2,  The  process  may  now  be  continue!  ana  the  general  result 
obtained  by  induction. 

before  proceeding  to  the  uestion  of  the  aryrnrtotic  behavior 
of  the  moments  we  prove  the  following 

Lemma  1  •  I£  v ( t )  satisfie s  the  equation 

-X 


(12) 


v(t— y)dH(y)  ♦  Kit) 
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and  is  bounded  on  every  finite  .interval,  where 


then 


(a) 

dH  >  0, 

H(0*) 

■ 

o,  h ( cd )  -  a  ^  i 

(b) 

|K(t) |  < 

Cl  , 

0 

<  t  <2  OD 

(c) 

K(  t )  — *■ 

c*  as 

t 

— >  00, 

(14) 


v  ( t ) 


c*  /  (1  -a), 


00, 


Furthermore .  if  J K ( t )  —  c%  (  ■  0(e  and  |  Oi  —  H(t)  |  ■  0(e  ^) , 

£  >  0 ,  as  t  — >  od,  then  there  is  a  £  >  0  such  that 


(15) 


|v(t)  -  c«,/  (1  -  (7JI  -  0(6  St), 


00. 


Proof.  First  assume  c*  -  0.  Since  v(t)  is  bounded  for 
0  <  t  <  T ,  we  have  from  (12) 


Jup  / v ( t ) |  <  H(T)  sup  f v ( t ) |  ♦  c,  , 

jvt<r  ~  u<t<r 


or 


Sup  J  v ( t )  | 

CKtvT 


Cl 

i  -  a  ’ 


Ihus  Jv(t)J  ^  cj  /  (I  -  06)  ,  u  ^  t  <oa.  Using  (12)  again ,  let 


v(  t )  -  Sup  |  v(T)  |  , 
T>  t 


K(t)  -  Sup  | K(T)  I  ; 
T->  t 
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then  for  any  T  >  0  and  integer  n, 

T 


(10) 


X(n4l)T]<  J"  v[(n+  1  ) T  -  yJdH(y) 


P(n*1)T 

♦  Jt  v[(n+  1)T-y]dH(y)*  K[(n*1)T] 


fc-H(T)]c,  - 

<3Lv(nT)  ♦  - —  —  ♦  K[(n*1)T], 


Cl 


Let  k  be  a  positive  integer.  Since  |v(t)|  <  — ZTfx  and  is  mori°tone 
decreasing,  the  inecuality 

(17)  v  ((n  ♦  1  )t)  >  v(nl')  -  kfT‘l  ^ 


must  hola  for  at  least  one  value  of  n  between  0  and  k  —  1,  say  n 
Combining  (17),  for  n  -  ,  with  (16)  gives 


(16) 


1 


1 


V  ( n0T )  <  —  bi  _o,)  + 


c,[<X-H(T)]  _  - 


1  -  CL 

Since  v(n0T)  >  v(k'f),  K[(n0  ♦  1  )Tj  <  K(T) ,  we  have 


♦  K[(n0  ♦!  )T] 


(19) 


1 


vUT)  ^ 


OL 


o,  c.it-h(T)]  F 

kTi  - oJ  ~ a  K(T) 


}■ 


*  nG. 


1  , 


•  • 


From  (19)  follows  (14)  for  the  case  c*  ■  0.  The  general  case  is 
proved  by  maKing  the  change  of  variable 


v*(  t)  -  v(t)  -  c2  /  ( 1  -  CL)  . 


The  proof  used  here,  although  lengthy,  shows,  by  means  of  (19),  that  for 
each  t,  |  v  ( t )  —  c2/(1  —  Jt)  |  can  be  bounded  by  a  quanti  ty  which  depends  only 
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on  J CjL  —  li(t)|  and  Sup  |K(T)  —  1 9  a  fact  we  shall  need  later. 

t  <  T 

If  |  K  ( t )  -  c*  I  and  J  O-  —  H  ( t )  |  are  both  0(«”^)»  choose  A, 

0  <  A  <  small  enough  that J^e/^tdH(t)  <1.  We  can  then  apply 
(14)  to  the  function 

v*(t)  -  e^t[v(t)  -  cd  /  (1  -  3-)] 

obtaining  (15).  Again,  the  bound  0(e  <^t )  in  (15)  depends  only  on 

|(X  —  ii  ( t )  |  and  Sup  |c2  —  K(T)  | . 

t<  T 

We  are  now  ready  to  consider  the  asymptotic  behavior  of  the 
moments.  Setting  s  “  1  in  (6)  we  obtain 

n  ^ 

(20)  m,(t)  ■  2  /  m,(t-y)dG(y)  ♦  1— G(t). 

Jo 

This  is  the  familiar  integral  equation  of  renewal  theory,  for  which 
general  results,  including  theorems  on  the  asymptotic  behavior  of 
mi(t),  have  been  obtained  by  Feller  f2]  and  Tacklind  £7j  •  However, 
there  are  special  conditions  satisfied  in  the  present  problem  which 
make  more  precise  results  possible.  On  the  other  hand,  as  Feller 
has  shown,  still  more  specialized  assumptions  on  G(t)  would  enable 
us  to  use  the  method  of  Lotka  to  expand  raj(t)  as  a  series  of 
exponent i  cl  1  S  • 

It  is  well  Known  that  the  solution  of  ( tO )  may  be  written  as 

m,(t)  -  1  ♦  ^  2rl— 1 0  ( t )  , 
n-1  n 


the  series  converging  uniformly  in  every  finite  t— interval,  where 
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r,t 

G,  ( t )  -  G(t),  Gn<M(t)  -J  Gn(t -y)dG(y)  ,  n  -  1  ,  2 ,  ••• 

Thus  continuity  of  G(t)  implies  continuity  of  m|(t)t  and  similar 
expressions  for  the  higher  moments  show  them  to  be  continuous  if 
G(t)  is.  Furthermore,  if  G ( t )  is  a  step  function  the  moments  are 
step  functions  with  discontinuities  only  at  points  of  the  form 
t,  ♦  t2  ♦  •••  ♦  tn,  where  tj ,  t^ ,  *  *  * ,  tn  are  points  of  discontinuity 
of  G(t). 

For  convenience  we  call  G(t)  a  simple  step  function  if  it  is 
a  step  function,  all  of  whose  steps  occur  at  integral  multiples  of 
some  unit. 

Theorem  J.  /issume  dG  >  u,  G(o+)  •  0,  G(a>)  *  if  and  that  G(t)  ^s  not 

a  simple  step  function .  then  the  solution  of  (20)  satisfies 

(21)  m,(t)  ^  n|eat,  t  — >  co, 

nj  *  1  j  Ji+a  t  e  atdG(t) 

where  a  ij>  defined  by  (4) . 


By  virtue  of  (3).  Theorem  2,  we  can  take  Laplace  transforms 
of  both  sides  of  (20),  obtaining,  for  Ue(s)  >  a, 

a> 


a> 


(22) 


I  Wm,(t)e  stdt  *  /'  fl  -  G(t  )]e"stdt  /  1-2  /  e“stdG(t) 

0  JO  '  ■  '  o 


Ti-3  Wf 


TT 


where 
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(f(s)  -  J)QD  e  stdG(t),  Re  (  s )  >  U. 

The  right  side  of  ( 22 ),  which  can  be  extended  analytically  to  the 
region  Ke(s)  >0,  has  a  simple  pole  at  s  ■  a,  and  no  other 
singularities  on  the  line  Re(s)  -  a,  since  G(t)  is  not  a  simple 
step  function.,  .Voreover,  we  have  shown  thatm|(t)  is  nondecreasing. 
We  can  therefore  apply  a  Tauberian  theorem  of  Ikehara  [&]  ,  which 
immediately  gives  Theorem  3« 

nt 

Theorem  4a.  Assume  G(t)  ■  /  g(y)dy,  g(y)  >  0,  G(u>)  ■  1,  and 

dO  ~ 

.  _0D  _  a. 

that  7 ( s )  *  /  e  g(t)dt  satisfies  the  conditi on  that  for  every 

J  o  '  .  .  ^ . . 

b,  O  <.  b  v  a, 


(23) 


CD 


~ U) 


.  7lb  ;  fo)  i 

i  “  !/! 


dy  <  a>  . 


Then  m,(t)  sat isf ies 

(24)  m,(t)  -  n,eat[l  ♦  Q(e  Lt )  ]  , 


e  >  o, 


where  n,  Jls  defined  in  ( 21  ) . 


Theorem  4b.  Lf  dG  >  0 ,  G(0+)  *  0,  G(u>)  -  1,  and  G  ( t )  jis  a  simple 
step  function .  the  smallest  step  being,  at  A  ,  then  for  each  QL, 

U  Jl  A  ,  and  integer  n, 


Ul-e'^likb.e*^ 
1  K 


m  j  (  J-  ♦  n  A  ) 


» 


6  >  o, 


n 
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where  ijj  the  magnitude  of  the  .lump  of  G(t)  at  t  ■  kA  and  bt  >  0. 

nt 

Theorem  4c.  Jf  dG  >  0,  G(G+)  ■  0,  G(od)  -  1,  G(t)  •  gj(y)dy  ♦ 

G^(t)  ,  gi  (y  )  >  0,  J'  Ei  (y  )dy  >  0  ,  (s)  «  e“9tg,  (t)dt 

satisfies  (23),  and  G-,(t)  i_s  a  step  function :  then  (24)  holds . 


Before  giving  the  proof  we  remark  that  there  are  two  simple 
conditions,  either  of  which  insures  that  (23)  holds.  If  for  some 
d,  0  s*  d  <  a,  the  function  g(t)e"~ ^  is  of  bounded  total  variation 
on  (0,  00)  ,  then  (<:j)  follows  from  integration  by  parts.  Another 
condition,  which  permits  g(t)  *  C  (t  ^)  ,  t  — >  O,  for  any 
U  <  £  1  ,  is  the  assumption  that  for  some  p  >  1  , 

(23)  P  g(t)pdt  v.  CD. 

U  0 


For,  applying  Holder’s  inequality,  with  0  <  b  <  a, 


(26) 


iV'tb*  iy )  1 

1  -  I  y ! 


dy 


IY{  b*  iy  )  I  p 


p00  dy 
u  Tjo  ( 1  ♦  |  y  I p 


P 


♦ 


1 . 


Since  V^(  b  *  iy)  is  the  Kourier  transform  of  e  “'’git),  we  have, 
the  Hausdorff— Young  inequality  for  iourier  integrals, 


(17) 


e-pbtg(t)Pdt 


using 


-25- 
KaOP  3 A 
Rev.  7/H/50 


From  (25)  ,  (2t>),  and  (27)  we  get  (23). 

The  proof  of  Theorem  4a  is  by  the  method  of  residues,  used 
with  what  Doetsch  calls  the  "indirect  Abelian"  method.  Since  ra,(t)  is 
continuous  (and  nondecreasing)  we  have  from  (22)  for  any  t>C,  b*  >a, 


(26) 


«  n  b '  ♦  iT  f 

m,  ( t )  -  lim  I  el 

T-^od  U  b'-iT  [ 


s[l-  2  Hs)] 


ds  . 


The  function  1  —  2  ( s)  has  a  simple  zero  at  s  ■  a  and  vanishes 

nowhere  else  on  the  line  he(s)  *  a.  Moreover,  since  9l[  s )  is  the 
Laplace  transform  of  an  absolutely  continuous  distribution  we  have 


lim  J  b  ♦  iy )  |  "0 

y — >^gd 


uniformly  in  b  for  0  v  b  ^  a.  We  can  therefore  find  b,  0  ^  b  <  u, 
such  that  1  —  2  V(  s )  has  no  zeros,  except  at  s  ■  a ,  in  the  atrip 
b  ^  he(s)  <  a  (clearly  there  are  no  zeros  for  Re(s)  >  a)  and  is 
uniformly  bounded  away  from  0  on  the  line  He(s)  -  b.  Then,  using 
Cauchy’s  theorem  for  the  rectangle  b  ♦_  iT,  b’  ^  iT,  we  obtain 
(the  integrals  along  the  horizontal  sides  of  the  rectangle  clearly 
— >  0  as  T  — •>  oj ) 


(29) 


m,  ( t ) 


n  j  eab  ♦lim 
TH*a 


b^iT 


b-iT 


i  4 
s 


y  (s) 


s  ( 1  “  2  ~K[  s ) 


-  >ds 


at  bt  . 
n^  e  ♦  e  ♦lim 


1 

2ni 


r>  b  +  iT  est  ///(s)ds 
1  b-iT  *  si  -2/1  s)) 


L  t 

where  n,  is  defined  by  (21)  and  n»e  is  the  residue  of  the  integrand 
at  s  ■  a.  The  conditions  imposed  on  9^(s)  in  Theorem  4a  insure  that 
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the  integral  on  the  right  side  of  (29)  is  Q(el>t)l  and  this 
concludes  the  proof  of  4a. 

To  prove  Theorem  4b  we  note  that  in  this  case  the  function 
^(s)  has  the  period  2ni/^  , 

n»)  -  r  •_"tdO(t)  *  Z  b.  e-lt^8  , 

'Jo  k  - 1  K 


bk>0, 


b,  >  0, 


1 . 


Thus  1  —  2  V'(s)  has  simple  zeros  at  the  points  a  *  2tt ir/£  , 
r  ■  u,  1,  and  because  of  periodicity  we  can  find  b,  u  ^  b  ^  a , 

such  that  1  —  2  ty'T  s  )  is  uniformly  bounded  away  from  U  on  the  line 
ite(s)  -  b,  and  such  that  if  b’  >  a,  the  only  zeros  in  the  strip 
b  <  Ke(s)  <  b*  are  those  on  Re(s)  •  b.  Moreover,  9^(s)  and 
£l  — V(s)J/  £l  —  2(/y(s)]  are  twice  continuously  differentiable 
on  Re(s)  -  b.  Thus 


1  -  Hb  ♦  ly) 
1  -2  H  b  ♦  iy  ) 


GO 


k"— co 


cke 


ikAy 

» 


Ck  -  C  ( 1/k2)  ,  k  ♦ 


Using  Cauchy’s  method  as  before,  we  obtain  the  principal  term  in 
Theorem  4b  by  summing  the  residues  on  Re(s)  ■  a,  with  the  remainder 


(30) 


ebt*iyt 
b  ♦  iy 


a> 

1  c.  f  <.00  and  since 
K*-cd  'c 


Since 
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(3D 


lim 

T-^od 


_L  r, T  eltyeikAy 
2n  j_T  b  ♦  iy 


dy 


e 

0, 


-b(t*kA) 


t  ♦  kA  >  0 
t  ♦  kA  <  0  * 


and  since  furthermore  the  convergence  in  (31)  is  bounded  uniformly 
in  t  and  k  provided  t  ♦  kA  is  bounded  away  from  0,  we  can  interchange 
summation  and  integration  in  (30),  obtaining 


(32) 


-b(  t  +  kA) 

cke 


This  proves  Theorem  4b. 

If  the  conditions  of  Theorem  4c  hold,  the  Laplace  transform  of 
mj(t)  can  be  written 

,  ,  1  V',(s)  /2(s) 

3  s  [l  -  2  /  ( s )]  s[l  -2  V'ls)] 

where 

%(s  )  -  J'“  e'stg,(t)dt, 

^(s)  -  P  e  stdG2(t)  ■=  z  v  k  . 

Jo  k-1  * 


Ak  >  0,  dk  >  0,  21  dk  <  1  • 


As  in  Theorem  4a,  1  —  2  (/^(  s  )  has  a  simple  zero  at  s  •  a  and  no  other 
zeros  on  Ke(s)  ■  a,  and  ( b  ♦  iy)  — >  0  as  y  — >  ♦  oo,  uniformly  in 
b  for  u  v  b  <  a.  We  can  thus  find  b,  U  <  b  <  a ,  so  that  s  *  a  is 
the  only  zero  of  1  —  2  7'(s)  in  the  atrip  b  <  Ke(s)  ^  a.  By  our 
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assumptions,  '/^(s)/  [s  ( 1  —  2  /M  s ) )]  is  absolutely  integrable  on 
fte(s)  *  b.  As  regards  the  third  term  in  (33),  we  can  write 


(34) 


it  2  r,  ^ 

sTi  -m2W  ■  irr=  a  vjj  4  sTv  --2 


The  second  term  on  the  right  side  of  (34)  is  absolutely  integrable 
on  Ke(s)  *  o.  If  a  —  b  is  sufficiently  small  and  positive,  we  have 


2  'Y ^  ( b  4  iy  )  |  1 


V/ 

uniformly  for  -xu  v.  y  a>.  Thus,  since  /  ^  is  an  absolutely  convergent 

series  we  have,  for  a  —  b  sufficiently  small  and  positive, 


t'A  s)  « 

i  -  2  Yjs)  fi 


00 


V  CO 


k -0 


.  !\  >  o. 


The  proof  of  Theorem  4c  is  then  carried  out  using  the  procedure  of 
4a  and  4b. 

It  is  now  easy  to  get  the  asymptotic  form  of  the  higher  moments, 
using  Lemma  1.  Let  uk(t)  •  V  Ml,  t).  Then,  as  remarked  earlier, 
we  cun  consider  the  asymptotic  behavior  of  u ^ ( t )  rather  than  m^ft). 
Setting  8  -  1  in  (12)  gives 

r.  t  nt  * 

(35)  u^(t)  e  2  I  ut  ( t  -  y  )dG(  y )  ♦  2  /  [n,(t-y)]  dG(y). 

'J  O  ( '  J 

Put  u^(t)  *  e<^atv4:(t).  Then 

(36)  v^(t)  »  2  P  ( t  —  y  )  e  <’dydG(y) 

Mo 

4  2  /  • 
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Now  2  [  e  2aydG(y)  ^  2jn  e  aydG(y)  *  1,  and  if  G(y)  is  not  a  simple 
step  function  we  have,  from  Theorem  4a,  e^^m^t)  — >  nj  as  t  — >  od, 

whence 

lim  2  I  [e"a(t”y  (t -y)]£e"*2aydG(y)  -  2n  f  T  e”2aydG(y). 

t  — ^  CD  '  '  0  V  0 


Therefore,  since  from  Theorem  2  v2(t)  is  bounded  on  every  finite 

interval,  we  can  apply  Lemma  1  to  (36)  obtaining 


Theorem  5.  Under  the  conait i ons  of  Theorem  3, 


lim  *'txt 

t  — >CD 


03 

1  -  zf"e~*ay dG(y) 


where  n 1  ij3  defined  by  (21),  and  a  is  defined  by  ( 4 )  . 


Results  corresponding  to  Theorems  4a,  b,  and  c  can  be  obtained 
in  the  same  way.  This  will  be  seen  more  generally  in  the  next  section 
when  we  consider  the  mixed  moment  E[Z(t)Z(t  *  h)]  . 


3 1 .  Mean  Sruare  Convergence  of  Z  ( t )  /  cn |  ( t ) . 

Theorem  6.  Under  the  hypotheses  of  Theorem  3  the  random  variable 
Z  ( t )  /m,  ( t )  converges  in  mean  square  to  a  ran  dam  variable  w  as  t  — >•  od  . 

Under  the  hypotheses  of  Theorem  4b,  Z(n£)/EZ(nA)  converges  with  proba— 
killLZ  one  to  a  random  variable  w,  and  also  in  mean  square . 

Theorem  c  of  course  implies  also  convergence  in  probability  to 
w. 
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Define  w(t)  by 


w(  t )  »  Z  ( t )  /  [n i eatJ  . 

It  is  clearly  sufficient  to  show  that  w(t)  converges  in  rn.s.,  which 
we  do  by  showing  that 

(1)  lim  Efw(t' )  —  w(  t)]  -0. 

t  ,  t  ’  — >  CD 


Differentiation  of 
J  1  2  (  S 

U)  - 


( 1 ) ,  Section 

1  ’  a*  ;  t]  ' 

‘  s,  ;  s^ 


3  ,  with 


3,-S^-l 


K 


1 ,  gives 
E[Z(t,  )Z(t2)] 


•  rn^  (  t  ,  ,  t^  ) 


t  j 

2  /’  m£(t,  -  y,  t2-  y)dG(y) 

Jo 


Set  tj*  »  t,  t^  ■ 
Then  (2)  becomes 

(  3  )  u(  t , 


t  ♦  h , 


, )  1 1 

♦  2  1  ni|  (tj  -  y)m,  (t2- y)dG(y) 

J  0 

♦  2  1  mi ( t2  —  y)dG(y)  ♦  1— G(t2). 

1 1, 

h  >  0 ,  and  let  m2t  t ,  t  ♦  h)  -  eahe2atu( t ,  h) . 


h) 


u(t-y,  h)e  2aydG(y )  ♦  c3 ♦  o(  1  ) 


as 


using  the  known  asymptotic  behavior  of  m,(t).  h  routine  estimation 
shows  that  the  o( 1 )  in  (3)  is  independent  of  h.  The  constant  c3  is 
given  by 
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(4)  c3  -  2n^ e  2aydG(y). 

It  follows  now  from  Lemma  1,  Section  5,  that 


(5) 


lim  u(t,  h) 

t- ^  CD 


_ C_3 _ 

1  -  2  /  00  e“2aydG(y) 


n2 


uniformly  in  h.  Thus  (see  the  remark  following  (19),  Section  5) 
(o)  E[Z(t)Z(t  ♦  h)]  -  nideahe2at[i  *o(1)],  h  >  0. 


Equation  (1)  now  follows  from  (6)  and  from  Theorem  5. 

If  the  conditions  of  Theorem  4a  or  4c  hold,  the  o(l)  in  (3) 
goes  to  zero  exponentially  and  it  follows  from  (15),  Section  5 
(under  Lemma  1),  that  there  is  an  £  >0  such  that  the  o(l)  in  (6) 
is  Q(e  '  )  .  From  (b)  and  the  remarks  following  Theorem  5,  there 
exists  a  (different)  6  >  0  such  that  (uniformly  in  h  >  0) 

(7)  h[w(t  ♦  h)  -  w(t)J  ■  C(e  6t)  ,  t  — >  00, 

which  implies  also  that 

(b)  h[w  -  w(t)]  -  0(e  ft)  ,  t  — >  00. 

From  (6)  we  have 

Theorem  ba .  Under  the  hv potheses  of  Theorem  4a  or  4c  the  random 
variables  w( nh )  ,  n  *  1  ,  ,  •  •  • ,  for  any  h  >  0 ,  converge  with 


probabi i  ity  1  to  the  random  variable  w. 
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For 

(9)  Efw  -  w(nh)1*  <  g>. 
n  ■  1 

which  implies  almost— everywhere  convergence.  Rather  than  the 

sequence  nh  we  could  consider  any  sequence  t  such  that 

"  ftn  .  ' 

e  s  a. 

n 

If  the  conditions  of  Theorem  4b  hold,  similar  arguments 
show  that  Z(nA)  /  EZ(nA)  converges  with  probability  1. 

We  define  the  moment— generati ng  functions  of  w(t)  and  w  by 

*$(s,  t )  “  E  |exp[sZ(t)e  at/  n,]j> 

•  F  [exp[se“at  /  n,]  ,  tj, 

M s)  -  E e3W,  Re(s)  <  0. 

Since  w(t)  converges  in  mean  souare  to  w  the  function  flf(s,  t) 
converges  to  ^(s)  for  each  s  whose  real  part  is  nonnegative, 
(iteplace  t  by  nA  if  G(t)  is  a  simple  step  function.)  Moreover, 
ff(s)  is  continuous  and  the  derivatives  ^^3  are  uniformly 
bounded  for  ite(s)  v.  0,  being  bounded  by  Ew(t).  Thus 
^(s,  t)  — >  ^(s)  uniformly  in  every  bounded  portion  of  the  half 
plane  he(s)  <  0.  Now  replace  s  by  expose  at/  njJ  in  (7), 

Section  4;  letting  t  — >  00  gives,  because  of  uniformity  of 
convergence , 

(10)  ^(s)  -  £  (se  ay)dG(y),  Ke(s)  <0. 

do 
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Summarizing  we  have 

Theorem  7.  Assume  G(0* )  ■  U,  G(u>)  ■  1  ,  dG  >  0.  The  moment 
generating  function  fi(  s )  of  the  random  variable  w  satisfies  ( 10 ) . 

(if  G(t)  is  a  simple  step  function  w  is  l.i.m.  Z(n&)  /  EZ(nA); 
otherwise  w  ■  l.i.m.  Z(t)/  LZ(t).) 

3 7 •  analyticitv  of  p ( s ) . 

Theorem  8 .  There  is  a  unique  function  s )  which  is  analytic  in 
some  neighborhood  of  s  ■  0,  and  satisfies  ( 10 )  of  Section  6 ,  with 
fSlO  t  *  *T(j)  *  1t  provided  that  G(0*)  ■  0 ,  jT  dG  “1,  dG  >  0. 

First,  assume 

OD 

(1)  ^(3)  *  CnS  »  C0  -  1,  C]  -  1. 

n  *  0 

Substitution  in  the  integral  equation  gives,  for  n  >  2, 

(2)  c  -  21  W  e~naydG(y), 

n  k  +  j-n  K  J  a  0 

p  tu  _ 

or,  setting  In  -J  e  naydG(y), 

(3)  °n  '  (K^-n  C“=j)  In/(’  "  2I"K 

*.J>1 

Since  1  -  21*,  >  u,  and  In  — >  0  as  n  — >  ®  (because  G(Q*)  -  0) ,  we 
can  picK  n0  so  that  for  n  >  nQ ,  I  /  (1  —  2Ir)  <1.  We  now  show 
that  there  are  constants  d  and  A  such  that 
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(4)  cn  <  Adn/  n  ,  n  >  1  . 

Assume  that  the  inequality  (4)  holds  for  1  <  n  <  N,  where  N  >  n0« 
Clearly  this  can  be  accomplished  with  an  A  which  satisfies 

(5)  32  A  jr  A  <  1 

k*1  k 


by  taking  d  sufficiently  large.  Then 


(b) 


r  A2rfN+1  ~  — 

CN  +  1  -  A  d  .  * 


k-1  k  (N  ♦  1  -  k) 


8A2d 


[n411 

Jill  V  J_  <  32A  d 
*  !*rr.  .2  -  , 


2  .N  +  1  00 


1 


MB  MB* 

rr  k^l  k2  ”  ( N  ♦  1  )  k»1  k2 


Combining  (5)  and  (6)  gives  (4).  It  can  now  be  verified  that  the 
series  defined  by  (1)  satisfies  the  conditions  of  the  theorem 
uniquely. 

§  8 .  Asymptotic  behavior  of  it )  as  t  — >  ♦  a>  • 

Since  the  substitution  s  ■  it  converts  the  Laplace  transform 
into  a  Fouriei — Stieltjes  transform,  the  cumulative  distribution  of 
w  may  be  evaluated  by  means  of  the  formula 

nl  -it,h\  — it,x 

(1)  K(x*h)-K(x)-lim  1  l-e  le  it  j  )/( ^nit ,  )dt ,  . 

T  U  -T  ‘  ' 

whenever  x  and  x  ♦  h  are  continuity  points  of  K. 

There  are  several  theorems  available  which  relate  the  behavior 
of  K(x)  to  the  asymptotic  behavior  of  ^(it).  Hence  it  is  of  some 
theoretical  interest  to  study  the  function  ^(it)  as  t  — >  eo. 
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Furthermore,  it  is  practically  important,  when  actually  determining 
the  cumulative  distribution  by  numerical  methods,  to  know  how  much 
of  an  error  is  committed  by  omitting  part  of  the  range  of  integration. 

The  result  we  wish  to  prove  is 


Theorem  9.  ns  t 


♦  CD 


(2) 


Wit) I  -  o(!t!_c/a)  , 


Co  _ 

provided  ^  dG  *  Q(e  °X)i  c  >  0 ,  as 


CD 


,  G(0+)  -  0,  G(co)  -  1  , 


dG  >  0,  and  G(t)  _is  not  a  step  function  with  one  step . 


The  proof  is  rather  long,  ana  we  shall  break  it  up  into  a 
succession  of  lemmas. 

x 


Lemma  1  .  <>s  t 


±  a),  it ) 


0.  ( 


n°° 

The  assumption  J  dG(y)  is  not 


required  for  this . ) 


Proof:  Since 


(3) 


00 


(rf(it)  -  /  eixtdK(x), 
i'0- 


for  small  { t|,  we  have  the  expansion 

2  QJ 

1  +  it  —  -%jr  j  x^dMx)  ♦  o(  It  j*) 


(4) 


tf(  it) 


(since  f  xdK(x)  *  1).  Hence,  by  a  familiar  argument  based  upon  the 
{J  0-  d 
Schv/arz  inequality,  for  Jtf  small,  f^(it)J  <1  if  t  /  0.  (The  strict 

z  k.  ^ 

inequality  (Ew)  *->  Ew  is  a  consequence  of  our  assumption  that  G(t)  is 
not  a  step  function  with  one  step.) 

he  remark  that  some  such  discussion  as  that  above  is  necessary 
to  distinguish  the  function  ^(s)  we  are  actually  interested  in  from 
other  functions  satisfying  the.  same  equation,  and  in  particular  from 
the  function  1,  which  is  a  solution  not  approaching  zero  as  t  — >  *  ®. 
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It  is  convenient  to  show  1‘irst  that 


lira  sup  |^(  it )  |  ^  1  . 
t 


Suppose  the  contrary.  Let  t3  >  0  be  such  that  MUt3)|  <  1  -  d , 
where  d  >  0,  and  such  that  Jj4(it){  <  1  for  U  <  t  <  t3,  and  let  t, 
and  t^  be  the  first  points  to  the  lefc  and  right  of  t3  for  which 
|^(it,)f  -  j^(it k)\  *  1  -  d.  Pick  A  -  j  log  —•  .  Then 

A 

jzf(it^)  -  /  fTUt^e  ay)dG(y)  ♦  /  ^dG(y) 


and 


1  -  d  -  |*f(itj|  v.  (1  -  d)  G(n)  ♦  1  -  G(A) 


whence 


(3)  U  -  d)G(n)  V  1. 

Now  let  t3  remain  fixed  while  d  — >  0;  then  t)  — >  0  while  t^  increases, 
so  that  a  — »  ou ,  G ( A )  — >  1,  and  (5)  cannot  continue  to  hold. 

Thus  we  can  suppose  that  J^(it)|  <  1  —  d  for  t  >  tj .  Take  B 
large  enough  so  that  1  —  G(B)  <t  t  t  and  t  large  enough  to  have 
te  >  tj,  where  *  is,  as  above,  log(  t^/t  j  )  /  a  .  Then 

|^(it)J  <  (1  -  d)  /  |^(  it  e  **y  )  JdG(  y  )  ♦  £ 

v  0 

or,  letting  7  ( t )  ■  sup  J^(iT)f, 

'?>  t 


(6) 


VI  t)  V  (1  -  d)GU)  V'lte  aA)  +  c  . 
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From  (t)  it  follows,  in  the  manner  of  previous  proofs,  that  f(t)  0 
as  t  — ^  gd .  A  similar  argument  shows  ^(it)  0  as  t  ->  —  ®.  (We  have 

purposely  not  made  use  of  the  anaiyticity  of  ^(s),  since  in  the  more 
general  case  where  fission  is  not  binary  ^(s)  may  not  be  analytic*.} 

So  far  no  condition  has  been  imposed  on  the  rate  of  approach 

of  G(t)  to  1  a s  t  — >  jo.  We  now  shov;  that  by  imposing  suitable 
conditions  on  this  approach,  we  can  derive  explicit  bounds  for 
|^(it)  |  as  t  — >  _♦  ao. 

Lemma  2 .  I_f  a_s  x  — uu , 

(7)  '  ”<i0=  0(e_cx),  c  >  u, 

'  J  X 

then  as  t  -  -  -»  2.  ^ » 

U)  Mlit)  I  -  Ciltp1,  , 

l£L  some  a  >  o . 

Choose  a  *  (log  t)/2u.  Then  from  the  integral  equation  we  derive 

(9)  Iff(  i  t )  |  <.  /'  |*T(ite“ay)  |dG(y)  ♦  1  -  G(A). 

From  the  delir.it ion  of  a,  we  have 

(10)  t(t)  a  1  -  G(A)  =  1  -  G[(log  t)/2a]  . 

Once  again  set 

(11)  /'( t )  «  Gup  [  ^(  iT)  f  . 

T>  t 


rtith  this  notation,  from  (9)  we  derive 
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(12)  V'(t)  i  T2(Vt)  ♦  u(t). 

Under  the  assumption  of  (7),  we  have,  for  large  t, 

(13)  ^(t)  <  T'  (  )  4  exp(-c  log  t/2a). 

Hence 

,  /  ^n+1\  -,n 

(14)  V^t  )  ^  f'  (  t  '  4  exp (—2  c  log  t/a) 

/  gn  N 

or,  setting  t 

(15)  un4l  ^  u*  4  exp{ —2n  c  log  t/a). 

applying  the  inequality  (u  +  v)  <  2{u  ♦  v* )  after  squaring  both  sides, 
the  result  is 

(It)  x  ,[U;  4  exp(-2n+1  c  log  t/a)]  , 


whence 

(17)  un^  ^  un+1  *  exp(-2n+ 1  c  log  t/a)  <  2un  ♦  3  exp(-2n41  c  log  t/a) 


Repeating  the  process,  we  obtain  at  the  k— th  step 

,k 

(IB) 


u 


<  v,  u^  4  w,  exp(-2n^  ^c  log  t/a) 


-  k  n 


where  and  w^  are  constants  for  which  we  will  now  obtain  upper  bounds 


In  fact  we  have 
(19) 


.,k— 1  ,  k  .jk-1  .  * 

■  >2  —  1  —1  „  0n^K— 1  ,  .  t  , 

un  +  k  ^  2  un  4  3  exp  -2  c  log  t/a  , 


the  validity  0 1’  (IV)  being  readily  established  by  induction.  Hence, 
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taking  n  ■  0, 


(20) 


0k-1« 

22  ’flKt)] 


-^k  n  k~  1  -  \e—  1 

2  4  3  1  exp(— 2k  c  log  t/a). 


It  fol lov:s  from  Lemma  1  that  we  may  choose  t0  >  1  end  large  enough  so 
that  ^(to)  <  £  and  c  log  t0/a  >  log  3.  Then  if  x  >  t§  we  may  .write 


(21  ) 


x  ■  t  , 


tj  ^  t  ^  tQ  | 


where  (21)  defines  uniquely  the  positive  integer  k.  Then  ( 20 )  gives 

2k-1  -  k_1 

(22)  fix)  <  ^[2  ^(t)]  4  1  [exp(log  3  -  c  log  t/a)]2 

-L  1l 

<  ^[2  ^(t0)]2  ♦  -j [ex p ( 1  og  3  -  c  log  t0/a)]2  , 

where  L  is  the  logarithm  of  x  to  the  base  t0 .  From  (22),  Lemma  2 


follows  immediately  for  t  — >  ®;  similarly  for  t 
Lemma.  3.  If  !  ^  ( t  C  )  J  -OUtf”),  d  >  O  ,  as  t  — 

|  *  C  (  Jt  fc/“) . 


1  <«»  then 


Proof:  The  relation  J^(it)|  -  OUt)-*1)  may  be  written  |^(it)| 
C)[(i  ♦  |t|)“dJ.  and  in  this  form  it  is  more  convenient  for  our 
purposes.  *e  have 

j  n  cd  — 2d 

(23)  ]^(it)J  <  cj  /  (14  J  t } e  y)  dG( y ) . 

<2  1) 


Integrating  by  parts,  this  becomes 


I 

j* 
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(24) 


< 


-C|  dG(y)/(l  ♦  JtJe  ay) 


2d' 


CD 


0 


^  °i  r 

j  0 


CD  ,  CD 


dG(x) 


^  (1  ♦  !  1 1 e-ay ) 


-2d 


dy 


* 

Cl  CD  1  .  ,  —2d 

v  - 723  ^  c*,/„  e  (1  *  dy) 


(14  |t(r“  O  0 


dy 


Integrating  by  parts  again,  we  obtain 

c3  ,  «  a-cy 


(25) 


Ta  *  C4 

(1  4  Jt|)2d  JO 


e  3  dv 


(1  4  Jt|e  ay) 


73 


Make  the  substitution  eay  *  { 1 1  v ,  obtaining 

— c/a— 1 


(26) 


C3 


(1  -  ! t ; ) 


cd  v  '  dv 

23  *  C,i  './It!  ,A)Jd 


!  t  rc/a 


The  integral  is 
(27) 


cd  —  c /a— 1  42d  ,  r 

7T*  *  C  [max  1  1  »  ' 1 1 


u  1 c / ®"“2  d  \ 


J.1  /  J  t  J  ( v  4  1  ) 


,  c/a  f  2d, 


as  t  — >  cd  . 

hence  il*  2d  .>  c/a,  we  obtain  the  desired  estimate.  If  not,  we 
obtain  |^(it)J  *  C  (  J 1 1  *^d).  This  process  may  now  be  repeated  using 
tne  new  estimate,  and  since  2nd  >  c/a  for  some  integer  n,  we  will 
eventually  obtain  the  desired  result.  Clearly  d  may  be  picked  so 
that  2n d  is  never  equal  to  c/a. 

This  completes  the  proof  of  Theorem  6. 
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It  is  possible  to  continue  in  this  way  and  obtain  bounds  for 

» 

t>  (it).  However,  since  we  are  principally  interested  in  showing 
that 

(  20 )  /  j/  (  it )  Jdt  <  jo  , 

U  — u> 

we  shall  merely  show  that  this  is  implied  by  the  relation  f/(it)|  ■ 
0(t  d),  d  0 ,  ana  by  the  integral  eouation  satisfied  by  /. 

V»e  have 

(k9)  /  (s)  *  2  P  /  (se  ay)/(se  ay)e  Qy  dG(y). 

‘JO 


From  thi?  we  ottuin  for  T  >  0, 


(  Ju) 


I  \6  ( it )  jdt  v  2 


c'  u 


I  -if  J  /  (ite  ay)|  j/(ite  ay)|dt 

do  I  Jo 


e  aydG ( y  )  . 


In  the  in;.er  integral  make  the  substitution  te  ay  ■  u.  Then 


(3D  u(T) 


J 


o  T  , 

|/  ( it ) jdt  ^  2 

o 


.I  n'i’e- ay 


(O 

1 


1/  (  it )  j  |/(it)Jdt 


C  O  |Ou 

,iT 


dG(y) 


2 


0 


[/  ( it)  I  J/( it)  | dt . 


d 


Since  /(it)  =*  0(t  )  as  t  — 

T 

(3 2)  B(T)  s  c  f  j/’(it) I dt /( 1  ♦  t)d. 

J  j 


co,  we  have  for  some  constant  c, 


Integratirip  now  by  parts, 
(33)  B(T)  ^  cB(T)/(1 


T 

♦  T)d  ♦  cd  /  B(t)dt/(1 

do 


♦  t) 


d*1 


-42- 
KnOP  )B 
Kev.  7/U/50 


Choose  T  large  enough  so  that  c/(l  ♦  T)  <  1/2  ;  then 

T 

(34)  B(T)  <  2cd  f  B(t)dt/( 1  ♦  t)d<1  . 

Jq 


Hence 


T 

(35)  B(T )/( 1  ♦  T)d41  <  [2cd/(1  ♦  T)d41]  J  B(t)ct/(l  ♦  t)d  +  1 


or,  setting  V(T)  -  J  B(t)ct/(1  ♦  t)0*1  , 


(36)  V *  ( T )  <  2cdV(T)/(  1  T)' 


Hence  V(T),  and  thus  B(T),  are  bounded  as  T  — >  a>.  m  similar 


argument  holds  as  t 


—  03  . 


§9.  Existence  of  a  Density  Function . 


From  the  results  of  the  previous  section  follows 


Theorem  10:  The  distribution  K(u)  of  w  _is  a  continuous  function 
of  u.  If,  in  addition .  1  -  G(y)  ■  0(e  cy),  c  >  0,  then  Mu)  is 

nu 

absolutely  continuous .  Mu)  ■  J  ic(v)av. 


Part  1  of  the  theorem  follows  from  the  fact  that  Mit)  — >  0 
as  t  — >  ®;  part  <  follows,  using  (1)  of  and  the  fact  that 


J It  (it)|dt  <  gq,  cf.  the  argument  in  p] ,  p.  4du 


hrtOP 
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^10.  hn  Example . 

Suppose 

■  tw;  yn',e_bydy- 

Let 


h(s) 


e_3tdG(t ) 


(1  ♦  s/b)  n. 


Proper  choice  of  n  and  fc  give  any  desired  values  for  the  mean  life 
length,  —  «'(0)  c  n/b ,  and  the  variance,  A"(0)  —  [h’(G)]]  =  n/b*  . 

The  root  of  A(s)  *  ^  is  given  by 

a  -  b(21^n  -  1 ) , 


and 

h[2(t)J  ^  [a  *  b)eat/(2an). 

Simi lar ly  , 

h(L(  t)]^  -  fEZ(t)]2  1  )e/at(a  ♦  b)*/  (Wn^(  1  -  21 

where  1*  »  n(2a)  ■  (1  ♦  2a/b)  n. 


1 1  .  Remarks . 

The  methods  alreaay  employed  can  be  used  to  treat  the  case 
where  instead  of  binary  fission  there  is  a  probability  qn, 
n  ■  J ,  1,  2,  of  transformation  into  n  particles.  The  proofs 

for  existence,  uniqueness,  and  generating— functi on  properties  of 
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F(s,  t)  are  essentially  unmodified.  The  rest  of  the  treatment 

co 

depends  on  the  value  of  m  ■  ^  nq  .  Just  as  in  the  simpler  case 

r  -1 

treated  in  [jj  there  is  a  positive  probability  that  Z ( t )  never 
vanishes  if  ana  only  if  m  >  1  .  If  m  >  1  and  21  nkQn  <  °°»  the 
results  on  the  asymptotic  behavior  of  mj(t),  j  <  k,  are  the  same 
except  for  different  values  of  the  constants  involved;  the  theorems 
on  mean  square  convergence  of  Z(t)/i£Z(t)  hold  if  m  >  1  and 
5"  n  <  00.  The  theorem  on  analyticity  of  ^(s)  at  s  ■  0  is  not 

generally  true  but  presumably  holds  if  the  radius  of  convergence 
of  h(s)  «  "21  qnsn  i3  greater  than  1.  The  function  ^(s)  satisfies 


(1) 


«.)  m  J*  h[/^se  ay^JdG(y), 


03 


e  atdG( t)  . 


From  (1)  we  see  that  ^(~au)  *  -u>  )3  *  W,  30  that  sj,  the  proba¬ 

bility  that  w  *  0  (and  also  the  probability  that  for  some  t, 

Z(t)  *0),  is  the  unique  nonnegative  root,  less  than  1,  of 


(2) 


hU). 


The  transformations 
h*  ( s ) 


h  [s  ( 1  -  Q )  +  Qj  -  w 

m  — —  —  ■ 

1  -  Q 


*Hs) 


1  -  Q 
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make  (1)  take  the  form 

(3)  ^*(s)  “So  ay^dG^yi* 

From  (3),  using  the  methods  of  Section  8,  we  can  show 

P  \6*  *  (  it )  |dt  <  ®, 

(J  —CD 

showing  thdt  the  distribution  of  w  is  absolutely  continuous  except 
for  a  jump  of  magnitude  Q  at  0. 

The  condition  G(U+)  *  0  can  be  partly  dispensed  with.  The 
condition  G (0+)  >  0  means  that  an  instantaneous  chain  reaction  may 
occur  at  the  very  instant  of  birth  of  each  particle,  producing  a 
whole  family  at  once.  If  hf(l)G(0*)  <  1  it  can  be  shown  that  the 
number  of  particles  produced  in  a  finite  length  of  time  is  finite 
with  probability  1,  and  a  treatment  analogous  to  that  of  this 
paper  can  be  given. 
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